Training Recurrent Neural Networks by a Hybrid PSO-Cuckoo Search Algorithm for Problems Optimization
نویسندگان
چکیده
Because of computational drawbacks of conventional numerical methods in solving complex optimization problems, researchers may have to rely on meta-heuristic algorithms. Particle swarm optimization (PSO) is one of the most widely used algorithms due to its simplicity of implementation and fast convergence speed. Also, the cuckoo search algorithm is a recently developed meta-heuristic optimization algorithm, which is suitable for solving optimization problems .Normally, the parameters of the cuckoo search are kept constant. This may make algorithm suffering from slow convergence rate. To overcome with this issue, a hybrid algorithm called (PSO-CS classifier)for adjusting the cuckoo search parameters is presented to improved cuckoo search algorithm by particle swarm optimization (PSO) for training recurrent neural network which its weights and bias trained using the (PSO-CS classifier) to deviate from being stuck in local minima) for two benchmark classification problems. Moreover, to combine the ability of social communication in PSO with the local search capability of CS .Finally, the performance of the proposed algorithm is compared with that of the standard cuckoo search and PSO Algorithms. The simulation results show that the proposed (PSO-CS classifier)
منابع مشابه
Training Artificial Neural Networks by a Hybrid PSO-CS Algorithm
Presenting a satisfactory and efficient training algorithm for artificial neural networks (ANN) has been a challenging task in the supervised learning area. Particle swarm optimization (PSO) is one of the most widely used algorithms due to its simplicity of implementation and fast convergence speed. On the other hand, Cuckoo Search (CS) algorithm has been proven to have a good ability for findi...
متن کاملMetaheuristic Optimization Algorithms for Training Artificial Neural Networks
Training neural networks is a complex task that is important for supervised learning. A few metaheuristic optimization techniques have been applied to increase the effectiveness of the training process. The Cuckoo Search (CS) algorithm is a recently developed meta-heuristic optimization algorithm which is suitable for solving optimization problems. In this paper, Cuckoo search is implemented in...
متن کاملA Hybrid Ga/pso to Evolve Artificial Recurrent Neural Networks
In this paper we propose a novel hybrid algorithm (GA/PSO) combining the strengths of particle swarm optimization with genetic algorithms to evolve the weights of recurrent neural networks. Particle swarm optimization and genetic algorithms are two optimization techniques that have proven to be successful in solving difficult problems, in particular both can successfully evolve recurrent neural...
متن کاملWeight Optimization in Recurrent Neural Networks with Hybrid Metaheuristic Cuckoo Search Techniques for Data Classification
Recurrent neural network (RNN) has been widely used as a tool in the data classification. This network can be educated with gradient descent back propagation. However, traditional training algorithms have some drawbacks such as slow speed of convergence being not definite to find the global minimum of the error function since gradient descent may get stuck in local minima. As a solution, nature...
متن کاملCSBPRNN: A New Hybridization Technique Using Cuckoo Search to Train Back Propagation Recurrent Neural Network
Nature inspired metaheuristic algorithms provide derivative-free solution to optimize complex problems. Cuckoo Search (CS) algorithm is one of the most modern addition to the group of nature inspired optimization metaheuristics. The Simple Recurrent Networks (SRN) were initially trained by Elman with the standard back propagation (SBP) learning algorithm which is less capable and often takes en...
متن کامل